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The article is devoted to mathematical methods of experimental detection of inter- 
active phenomena in complex systems and their analysis. 



This article may be regarded as an account of conclusions from the ten year au- 
thor's practical researches on the joint of experimental mathematics, experimental 
psychophysics and computer science in the problems of visual perception in the in- 
teractive videosystems and from his parallel theoretical studies on interactivity and 
tactics. The current exposition is self-consistent and claims a minimal knowledge 
of the experimental or theoretical basis, which underlies it. The goal of the article 
is to discuss the methods of experimental detection of interactive phenomena and 
of their analysis. Though the author had deal presumably with the interactive phe- 
nomena in perception the resulted scheme is applicable to many systems of natural, 
behavioral, social and economical sciences and it is reasonable to think that many 
concrete specialists will find it useful for their own needs in the nearest future. 

I. Experimental detection of interactive phenomena 

Let us consider a natural, behavioral, social or economical system S. It will be 
described by a set {</?} of quntities, which characterize it at any moment of time t 
(so that tp = (ft). One may suppose that the evolution of the system is described 
by a differential equation 

<p = $(<p) 

and look for the explicit form of the function $ from the experimental data on the 
system S. However, the function $ may depend on time, it means that there are 
some hidden parameters, which control the system S and its evolution is of the 
form 

if = $(ip,u), 

where u are such parameters of unknown nature. One may suspect that such 
parameters are chosen in a way to minimize some goal function K, which may be 
an integrodifferential functional of ipt'- 



K = K{[y T ] T<t ) 



(such integrodifferential dependence will be briefly notated as K = K([cp\) below). 
More generally, the parameters u may be divided on parts u = (ui, . . . , u n ) and each 
part Ui has its own goal function Ki. However, this hypothesis may be confirmed 
by the experiment very rarely. In the most cases the choice of parameters u will 
seem accidental or even random. Nevertheless, one may suspect that the controls 
Ui are interactive, it means that they are the couplings of the pure controls u° with 
the unknown or incompletely known feedbacks: 

Ui = Ui(u°, [<p]) 

and each pure control has its own goal function Ki. Thus, it is suspected that the 
system S realizes an interactive game. There are several ways to define the pure 
controls u°. One of them is the integrodifferential filtration of the controls uf. 

«? = *;([«*],[¥>]). 

To verify the formulated hypothesis and to find the explicit form of the convenient 
nitrations Fi and goal functions Ki one should use the theory of interactive games, 
which supplies us by the predictions of the game, and compare the predictions with 
the real history of the game for any considered Fi and Ki and choose such nitrations 
and goal functions, which describe the reality better. One may suspect that the 
dependence of Ui on <p is purely differential for simplicity or to introduce the so- 
called intention Gelds, which allow to consider any interactive game as differential. 
Moreover, one may suppose that 

Ui = Ui(u°,(p) 

and apply the elaborated procedures of a posteriori analysis and predictions to the 
system. 

In many cases this simple algorithm effectively unravels the hidden interactivity 
of a complex system. 

II. Analysis of interactive phenomena 

Below we shall consider the complex systems <S, which have been yet represented 
as the n-person interactive games by the procedure described above. 

2.1. Functional analysis of interactive phenomena. To perform an analysis 
of the interactive control let us note that often for the n-person interactive game 
the interactive controls Ui = Ui(u°, [</?]) may be represented in the form 

Ui = Ui(u°, [<p];ei), 

where the dependence of the interactive controls on the arguments u°, [<p] and e% is 
known but the e-parameters Si are the unknown or incompletely known functions 
of u°, [e\. Such representation is very useful in the theory of interactive games and 
is called the e-representation. 

One may regard ^-parameters as new magnitudes, which characterize the system, 
and apply the algorithm of the unraveling of interactivity to them. Note that e- 
parameters are of an existential nature depending as on the states <p of the system 
S as on the controls. 
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The e-parameters are useful for the functional analysis of the interactive controls 
described below. 

First of all, let us consider new integrodifferential nitrations V a : 

v° a = V a ([e],[v]), 

where e = (ei,. . . , e n ). Second, we shall suppose that the e-parameters are ex- 
pressed via the new controls which will be called desires: 

Si =e(vl,... ,v^,[(f}) 

and the least have the goal functions L a . The procedure of unraveling of interac- 
tivity specifies as the nitrations V a as the goal functions L a . 

Example. Let us considered the interactive videosystem directed by the eye move- 
ments of an observer. The pure controls are the slow movements of eyes, whereas 
saccads are considered as a result of the unknown feedbacks (tremor is supposed to 
be random). Many classical and modern experiments clarifies the role of saccads 
in the formation of the stable and complete final image so such formation may 
be regarded as their goal function. The functional analysis of the eye movements 
extracts the parameters (the normal forms), which describe saccads in the con- 
crete interactive videosystems. The normal forms are extremely interesting in the 
multi-user mode when the saccads of various observers begin to be correlated and 
synchronized. 

2.2. The second quantization of desires. Intuitively it is reasonable to con- 
sider systems with a variable number of desires. It can be done via the second 
quantization. 

To perform the second quantization of desires let us mention that they are defined 
as the integrodifferential functionals of Lp and e via the integrodifferential nitrations. 
So one is able to define the linear space H of all nitrations (regarded as classical 
fields) and a submanifold M of the dual H* so that H is naturally identified with a 
subspace of the linear space O(M) of smooth functions on M. The quantized fields 
of desires are certain operators in the space O(M) (one is able to regard them as 
unbounded operators in its certain Hilbert completion). The creation/annihilation 
operators are constructed from the operators of multiplication on an element of 
H C O(M) and their conjugates. 

To define the quantum dynamics one should separate the quick and slow time. 
Quick time is used to make a filtration and the dynamics is realized in slow time. 
Such dynamics may have a Hamiltonian form being governed by a quantum Hamil- 
tonian, which is usually differential operator in O(M). 

If M coincides with the whole H* then the quadratic part of a Hamiltonian de- 
scribes a propagator of the quantum desire whereas the highest terms correspond 
to the vertex structure of self-interaction of the quantum field. If the submani- 
fold M is nonlinear the extraction of propagators and interaction vertices is not 
straightforward. 

2.3. SD-transform and SD-pairs. The interesting feature of the proposed de- 
scription (which will be called the S-picture) of an interactive system S is that it 
contains as the real (usually personal) subjects with the pure controls ui as the 
impersonal desires v a . The least are interpreted as certain perturbations of the 
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first so the subjects act in the system by the interactive controls Ui whereas the 
desires are hidden in their actions. 

One is able to construct the dual picture (the D-picture), where the desires act 
in the system S interactively and the pure controls of the real subjects are hidden 
in their actions. Precisely, the evolution of the system is governed by the equations 

tp = §((p,v), 

where v = (vi, . . . , v m ) are the ^-represented interactive desires: 

v a = v a {v° a , [<p];e a ) 

and the e-parameters e are the unknown or incompletely known functions of the 
states [<p] and the pure controls u°. 

D-picture is convenient for a description of systems S with a variable number 
of acting persons. Addition of a new person does not make any influence on the 
evolution equations, a subsidiary term to the e-parameters should be added only. 

The transition from the S-picture to the D-picture is called the SD -transform. 
The SD-pair is defined by the evolution equations in the system S of the form 

ip = $((p,u) = &((p,v), 

where u = {u u . . . ,u n ), v = (v 1 , . . . ,v m ), 

Ui =Ui{u°, [<p];ei) 
v a =v a {v a , [(p];e a ) 

and the e-parameters e = (s\, . . . ,e n ) and e = . . . ,e m ) are the unknown or 
incompletely known functions of [cp] and v° = (vf, . . . , v^) or u° = (u^, . . . ,u^), 
respectively. 

Note that the S-picture and the D-picture may be regarded as complementary 
in the N.Bohr sense. Both descriptions of the system S can not be applied to it 
simultaneously during its analysis, however, they are compatible and the structure 
of SD-pair is a manifestation of their compatibility. The choice of a picture is an 
action of our attention: it is concentrated on the personal subjects in S-picture 
(the self-conscious attention) whereas it is concentrated on the impersonal desires 
in D-picture (the creative attention). 

2.4. Verbalization of SD-pairs and synlinguism. The main problem is to 
interrelate the S- and D-pictures of the system S. One way is a verbalization of 
SD-pairs. Let us remind a definition of the verbalizable interactive game. 
An interactive game of the form 

ip = ®(tp,u) 
with e-represented couplings of feedbacks 



Ui = Ui(u°, [(p];si) 
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is called verbalizable if there exist a posteriori partition t < t\ < t 2 < . . . < t n < . . . 
and the integro differential functionals 

w n (e(r),^(r)|t n _i^r^t n ), 
ti*(ti (r),v?(r)|t n _i^r^t n ) 

such that 

u n = 0(w n _i,<;vj(r)|t n _i^r^t n ), 

quantities u n are called the words. 

Let us now consider the SD-pair and suppose that both S- and D-pictures are 
verbalizable with the same u n . The fact that u n are the same for both S- and 
D-pictures is called their synlinguism. One may characterize it poetically by the 
phrase that "the speech of real subjects is resulted in the same text as a whisper 
of the impersonal desires". The existential character of the synlinguism should be 
stressed. Really it is not derived from the fact that the objective states if of the 
system S are the same in the S- and D-pictures. The synlinguism interrelates the 
different e-parameters of existential nature in both pictures. 

The synlinguism is very important in the analysis of tactical phenomena, which 
essentially used the concept of verbalization in their definition. To my mind the 
synlinguism lies in the basis of psychophysical nature of mutual understanding of 
the independent subjects of a dialogue communication. In this situation it allows 
to identify the personal interpretations with the impersonal ones, unraveling the 
role of impersonal desires as bearers of the objective sense and its dynamics. 

To the verbalizable SD-pairs some procedures of linguistic analysis are appli- 
cable. Some of them are inherited from the verbalizable interactive games (the 
grammatical analysis), some are specific (the explication and analysis of objective 
sense) . 

III. Conclusions 

Thus, mathematical procedures of the experimental detection of interactive phe- 
nomena in complex natural, behavioral, social and economical systems and their 
analysis are described. The special attention is concentrated on the role of desires 
and their second quantization as well as on the abstract structure of SD-pairs, their 
verbalization and the synlinguism. 
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